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prograi that incorporates an Expert lodule wh±c$ allows the tutor to 
compare the student • s response to those generated by an. expert was 
developed for use with lumpus, a simple maze-exploration game. The 
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The Wumpus Advisor program .offers adyice to a player involved in ctiooslng the best 
move in a game for which competence in dealing with incomplete and wtcertain knowledge 
Is required. The design and .implementation of the advisor explores 'a new paradigm in 
Computer Assisted Instruction, in which the performance of computer-based tutors is 
greatly improved through the application of Artificial Intelligence techniques. - This report 
describes the design of the Advisor and outlines directions forjfurther w^rk* Our 
experience with tfie tutor is informal and psychological experimentation jema ins to be. done. 
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L Introduction < 
' . .»'■ ' » ' \ 

The Wumpus Advisor grew out of a coarse we gave in Educational Technology to a 
small 'group of graduate and undergraduate students at M.LT. Our goal was to explore a 
neiv paradigm in Computer Aided Instruction, in which the competence of computer-based 
tutors is greatly improved by applying Artificial Intelligence techniques to their design. We 
•particularly wished to study the structure^ Intelligent Computer Aided. Instttoctkxi (ICAI) 
programs that incorporate an Expert module which, allows the tutor t(T"cofnp&rt the 
student's response to those generated by the expert tossing the term ICAI apd exploring 
the consequences for a tutorial program of the availability of an'expert module, -we follow 
the lead of John- Brown. (Brown and Burton 1975), who has shown in his design of 
sophisticated instructional environments for electronics, the promise of thb approach. 

' if ' . y 

In order to experiment with this pacadlgm, an ICAI program for a simple game was 
implemented as a course project. The program serves m an Advisor to a player, offering 
advice and analysis at appropriate times. We chose Wumpus, a maze-exploration gajine, 
because^ represented the next step in complexity beyond the tutor designed by' Burton te 
Brown for West, a simple game on the Plato system for exercising arithmetic skills (Burton 

\ W6). Wumpus is motivating and requires a variety of skills covering planning, plausible 

> 

reasoning, decision Theory and Incomplete and uncertain knowledge. t ■ 

The Wumpus. Advisor was successfully implemented by the 'students in the course 
/ under StansfieW's supervision. The program was later improved and extended by Carr, 
who is continuing to work on the project This paper describes the current state of the 
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program 4hich gives appropriate.advke id English about the logic involved in* choosing a 
best move, tour different levels of student are catered for but other than, this broad 
distinction there is little student modelling. This aspect of the research 1* currently being 
f developed^ , 

By studying simple teaching situations and modelling them with programs that teack- 
we gaih insight into the processes underlying learning and teaching. The rich metaphors- 
of computer programming help us to describe teaching and learning (precisely and in detail 
while the discipline imposed by requiring a working program weedqout impractical ideas 
and points th/way to better ones. 



CAI programs need models of situations and students if theyjtre Co understand what 
is going on and act appropriately., We must provide them with practical procedures for 
making decisions about teaching and give thdn a precisely formulated knowledge of their 
subject matter so thlt theyyan interpret, model and act in a variety of teaching situations. 
They-abo need an expressive means of communication such as natural language, display 
screens and tablets for both interpreting the students behaviour and making effective 

.responses. * * » v 

* t * v 

Many early teaching programs and some current ones were^fact dispensing" 
machines. They used, the "empty bucket" theory of teaming, a trivial one in which the 
learner is simply a receptacle to be filled with facts. Although this theory may be decorated 
with extra raits to present facts in special orders or in clusters, it is very naive and hardly 
says anything at ad about real (earning. The key computing concept which it excludes 4 is 

that of a process. The student jhouH above all else bj learning how to do something and 

[ • 
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should be participating In various activities toward that end. He is programming himself 
with the teachers assistance. By changing the paradigm from facts to procedures the, whole 
enterprise ft greatly enriched. 

From this viewpoint we are forced to analysejhe student's learning usbAnd compare 
this with his behaviour. It becomes important to notice and correct the things he does 
wrong, forgets to do, does unnecessarily or does in the wrong order. Many Ideas from 
Computer Science artof great significance to this. The student's task can be modularly 
decomposed Into subtasks with individual, goals. These subtasks can be organized as 
processes, coroutines or steps in .a procedure The vocabulary oT Computer Science is rich 
in precise concepts for describing this. Similarly, his organization of Information and 
methods mutt be examined and debugged. There are sufficient partially-formulated 
concepts in AI that deal with perception, natural reasoning, organlslngjknowledge. planning 
and so on. for new descriptions to be made of the learning and teaching process 

The Wumpus Advisor develops the application of computers in education. It is the 
first version of a program which help* a s£Sent* to learn a simple game called Wumpus 
(Yob 1975). Acting as an interface between the student and the game, it Intervenes 
whenever the student's n\pves show that he needs advice. Advice is giver! as English * 
discourse explaining in full the meritt and faults of particular moves., Wumpus is played 
m a network of tunnels whose connections are initially unknown to the player. He must 



» „ r ,„ 

search thu network avoiding dangers and, trying to find and kid the dangerous and deadh/ 
Wrfnoui Throughout phy the advfcor gives the student Information about his immediate 
locality and evidence about nearby dan^t. From thU information It is possible to make 
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plausible inferences and judgements which aid in avoiding danger*. The game is highly 
motivating to"children and exercises several types of reasoning skill. 
( The game paradigm for advisors has also been researched by Burton using the game 
West (Burton and Brown 1975). Wumpus is a "more complex game and is a natural next 
step. In general, games form excellent subject matter for advice giving. They are. varied, 
provide motivation, and exist at many degrees of difficulty. Some, such as. Chess, have 
large bodies of advice associated with them In the literature. Games are often models of 
real-world situations and develop abilities that are useful in everyday life. Many of the 
strategies involved in the game of Go are of this nature. 

There are five good reasons for using a simple game as the domain of. an advice-' 
giving program. 

* 

* 

I. Closure . 

The rules are clearly defined. Since it U easy to describe what constitutes a legal move the 

S .. r 

student can always be expected to play within the rules even if he plays badly. This means 
that the advisor win be able to make sense of his inputs: With a less bounded domain it is 
easy for breaks in ^communication to occur because the program cannot understand the 
student S 

*• *' ** 

Z Expertise 

We can easily design an expert player for many simple buif interesting games- An {Xpert 
gives ft precise procedural theory of the domain whfch we aim to teach. 
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For simple games the same theory, of good play applies at eadi move. The rules that the 
expert uses are good at all stages of the game. This gives generality to the teaching 

# 

situation. A Skill is being taught which is exemplified hi different ways throughout the 
ganie. 

4. Simplicity 

It is easy to find simple examples of games well within programming capability. 

5. Motivation \ 

The student Is motivated by a game when he may not be by traditional curricula r domains. 



i 



These properties make it easy to sustain an interaction between the student and the 

teacher. Even whh no advice-giving at all, the game scenario provides a continuing 

exchange. In a sense this is cheating for it makes it easy to write a "toy" program but the 

important point l^that we can start from such a position and enhance the advice giving 

step by step. This is the way people team games in any case, beginning with the rules and 

* 

accumulating strategies which cover progressively more situations. r * 

Our .general methodology was to find a domain which the computer can deal with 
easily, which requires i^ly simple inputs but which has a large set of states. Games fit ihis 
well. Electronics does too as Sophie, the electronics advising program (Brown and Burton 
1975), shows. Sophie helps\ student learn hew to repair a faulty electronic circuit A faulty 



V 



circuit can be simulated. Mijves correspond to measurements or alterations and, though 
there are only a few move types, the possible hypotheses that can be made about a faulty 
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circuit are numerous and varied. Domains lik< ? geography qr history are hard to use in a 
CAI program. They are very knowledge-oriented and tend not to be closed. Limited and 
^l-structured aspects of them must be used if the domain is not to expand continually or 
the sttidei^Ms not to overreach the program^knowtedge (see Collins |975 for promising 
work in this direction). 

# 

A simple game like Wampus makes the task of writing an advisor manageable but 
does not wtdude impoijant features of the teaching process. Models of the itudent. ways of 
usjng them to provide relevant advice, questions of motivation and of not overad vising, 
on all be studied even for a simple game. We have not programmed any student 
modeHing faculty yet in our advisor though the work we have completed is a preparatory 
step. 



> , Th « » tud « nt •» doing »«veral things when {wphy» Wumpus with the advisor. First, 
n he Is learning how to ptay Wumpus. An adaptation of the program could also teach him 
variations^nd perhaps entirely different types of game. By learning Wumpus he learns 
certain reasoning and planning methods. These are of various types which we summarize 
shortly. At a more general level, the student is learning how to approach new game* and 
what methods are appropriate for unravelling the consequences of a given set of rules. 
This If notr-festricted to. games. There are more general situations with logical properties 
and rules and he might be developing a skill in producing effective procedures for acting 
In these situations When first in a new situation one mustdjrect the most resources 
towards an understanding of the situation. As skid accumulates, fewer resources are needed 
and eventually tuning up and debugging is only done rarely: This is a general property of 
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skill aquisKkm. (See Sussman J97J, for a computer fnodel of this kind of learning.) 

r 

The corre sp onding aim of an advisor is to help the student learn how to do all this. 
Our current Wumpus Advisor only tdvises on. particular points ohptay so the student will 



only build up general skills indirectly. Later, we describe an approach that can be taken to 

improve the Wumpus advisor and tonitder decision making skills in more general terms 

showing how the advisor might teach these * . y 

There appear to, be several different styles of playing and thinking about Wumpus. 

r People bring a variety of attitudes to the game. Some phy very safely Whik others play 

with abandon for the fun of taking risks. Those who approach the game from the point 

of view of its logical structure are more likely to learn efficient play in a shorter time that 

' • , r s 

tho«e who neglect this structure. On the basis of informal observations, they appear to 

quickly absorb and benefit from the current program's style of advice. Players who see the 

game frqn^Qther viewpoints might also benefit from our advisor's analytic approach which 

can ^generalized widely to other domains. However, the current advisor does not giv/ the 

fradual and sensitive advice about logical rules which must be provided for a student 

whose manner of play is different from its own. Again, on the basis of informal . 

observations, we find that such subjects ignore long technical advice because it spoils the 

fun of the game. A more appropriate advisor would understand their motivations and 

treat the logical aspect as only one of several Thiols an area which deserves considerable 

research. ^ 



io 
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L> Analytical and Synthetic approaches to learning games. ^ 

» .1 

< When a student is given the rules o^Wumpus he must first analyse them to 
determine their implications. There are/several ways he can do this Firstly he can 
experiment,, playing a variety of possibly risky moves until he empirically determines the 
regularities. In complex situations experimentation is combined with induction to generate 
and test hypotheses. A more direct method of analysis uses logic to infer properties of the 
game so that strategies can be developed to^ke advantage of these properties. , This is 
very clearly illustrated in Wumpus. The player knows some1>ut not all of the state of the 
board at any time. He can analyse the laws of the game and can develop about one. dozen 
precise rules of inference that he can use to help locate the Wumpus and avoid dangers. 
He must embody these rules in a procedure for analysing a board situation and must use 
synthetic principles to do thi* The Advisor contains an expert Wumpus player which has 
all of these rules already available to It When relevant, it points out examples of the rules 
to help the player make his move. The player is made to consider the corresponding rule 
and incorporate it into his play.,, 

, -T echniques of synthesis are used to construct programs and plans. Goldstein 
(Goldstein and Miller, 19%) describes a classification scheme for plans in the context of 
togo program writing. Typical examples are. linear plan, recursive plan and parallel phm. 

Acquiring skid at Wumpus can be seen as syhthesiiing a set of programs, so different 

t • ' / 

synthesis techniques lead to different Wumpus playing strategies. Many problems are 

■ encountered when assembling separate pieces of advice into a coherent strategy. Some rules 

have, preconditions and may only bt Invoked in certain situations. A strategy which only 
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applies in certain circumstances wilt otherwise give rise to bad play. It is useful to explain 
errors in the student's model of, play in terms of debugging and recognisable bug types. ' 
The student may then learn to recognise bug types himself and gradually build up a 
repertoire of repair techniques. V ) 

1J Methods appropriate to Wompus 

Besides general % techniques of synthesis and* analysis there .are those^hich are 
associated with particular domains. Wumpus includes two types of knowledge omitted from 
previous teaching programs. These are incomplete and uncertain knowledge. A Wumpus 
player usually knows only* a portion of the board and must develop procedures which can 
act effectively under these conditions. Three generaVjnethod* decision theory/probability 
theory, and planning are useful techniques for this type of situation. 

« 

7 

« « 

1. Planning . « 

To play a game well one has to plan and should learn^avo^certaln planning bugs such 
as planning too far ahead or too unevenly. There are often good reasons for choosing a 
few candidate movesjmd restricting lookahead only to these AI has a considerable bpdy 
of knowledge about planning in various domains apd these principles should be taught by. 
a good advisor. 

2. Decision Theory. 

v 

Because Wumpus Involves uncertainty and most moves have a combination of valuable 
and dangerous outcomes we can well apply .the decision theory paradigm which is useful in 
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iny.more gen&l situations. This theory show how to assign values and costs to 
of outcomes and gives a way of comparing thes^^Hties when the outcomes' 
calculable probabilities, ft Incorporates a. back-up algorithm that combines 
\ - planning with evaluating particular states*. * * ' 

8. Probability. ' * . ^ . ** •' 




In any uncertain situation probabilistic heufistks may be used to advantage. Estimating ' 
th« probabilities oWeajh *£-each move is crucial to good Wumpus play and out program 

.•„.'> • • - . \ 

uses quajitative probabilistic rationing in its expert player and for giving advice. 
1.4 The rales of Wampus. t - 

«* : "v 

Wjtmpus is played by one player r i Wumpus hunter, in a world consisting of -a 
number: of caves connected by tunnels. The player moves around this warrm trying to. 
avMd dangers and^4th the goal of finding and shooting the Wumpus. Initially the huntet 
onht knows the structure of the warnjp immediately around bim. He knows the number of 
thycave he is in and of all caves directly connected to him by tunneb. Eve/y^time hj^ 

tes a rnovi, which must be into a neighboring cave, he is told the cave-numbers 
neighboring. his new cave. T3h«\dangert of the warren are pit* bats and the Wumpus 
which, Hke the player, are initially located at random in the warren. . Any n)bve into a cave 
aining a pit or Hie- Wumpus results In . instant death. If the player moves into a bat 
cav'/he to tarried away by the bau and dropped into a random cave which may of course 
contain danger. Bats are not fast enough to uve the player from pits or the Wumpus if he 

inadvertently wanders into a cave containing both bats and one of these hazards. They do 

'Hi 
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carry the player away before he gets a chance to see what the neighbors of the bat cave are 
r though. There. are clues whkh help io avoiding the hazards. . The player hears squeaking 
* if he is one cave away from a bat and he can feel a -breeze if he is one away from a-pit. 
H« can also smell the stench of the*Wumput from up to two caves awaybuj cannot tell the 
directly. None of this evidence tells the player the direction of a hazard. The 
a bow ana^ffce arrows which he can fire at any time into a neighboring cave. 
The arrow wi|l ricochet at random through the warren for up to a distance of five caves 
win kill the Wumpus if he is hit It is possible that the arrow will by chance find Its 
way back and kid the hunter. A typical warren will contain 20 caves 3 bats. 3 pits, the 
player, and the Wumpus, ' 

1.5 A Wampus Scenario* 

i 

The student's input is in bold type tlte Computer's output is in italics For the sake of 

* .. » 

^pdability we have taken tt jjm£L ot editin ? the advisor's output by. for example, using 
pronouns to refer to caves Ht&ffafe already been mentioned. We could easily update the 

m program to effect ntost of these Ranges itself. In the case of pronoun reference, 
Winogradt program (Winograd 1973) provides methods that are sufficient for the limited 

examples in this scenario, k ^ 

1 

* 

Httlolra. I sh you art a beginning pkjtr. You fa* had 5 wins and Moists. Ltt's ggin. 

* 

You art t at mm 13 mUh nttgkbors 4, 14, (T, and 8. Brrrrl I fttl a draft. You art ntar a pit.' 
What a stanch. I smtll tkt Wumpus I What now? y 
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I wish you luck. You art at en* 4.uith neighbors tarns 14, 6. 2 t and 19. Brrrr! Squeak/ A 
* bat Is near. What rum? 



14 



This I* a dangerous moot. You hoot ban in two neighbors of 14 and you felt a draft in both. 
This is double eoUence sou is probable that a mis there. What now) 



( 



Atfrke 



Cave Sis abetter taoe to explore. What now? 



Why 



There is no danger from the Wumpus at 14 ori.lt is possible that 8 contains a pit but It Is 
more Ukoh that there is one at 14. What no*? 



You are at tern 8 with neighbors 19, 1, 15 and 9. What a stench/ What rum? 
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4. 



Kmc or« of /p «ka neighbors p)^, mid 6. *8<pudk! What notfi 



*4 



r*<i (i a good mm, Ira; Una it Is on Us 
•lUk n^ghbars 19, 1, 15 and 9. IPtat a i/< 




f A* soft cawts / 0*4 9. You are at cavt 8 
katnoofi 




You ate at am I mth neighbors 12, J, and 9. What a stench! What mwf 
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That is a rUkt move. The ,W}tmpus could be in J2 because you haven't found any copes that 4 
are within two cooes of 12 that wore smelt free. What nov? / ' 

Advice. ' * 

i ' ' ' ' 

You should, visit all the ernes which you know arrsofe before fou start taking risks, cjsoe 9 is 
a good cave to. explore. Uke 1% it is free from bats and pits; however, the Wumpus cannot be 
at corn 9. What now? \ - . 

■ fA* Wkm^cj Wr# «/ com 9, rtat be next to him and you would smell him at 

cam 19. But} you didn't smell htm at caoe 19, so 9 U safe. What now? ^ 



f 

t 




You trt tent 9 wUk nUrfJbors 8, 7, 10, end I. Whti* sttnch! What rum? , 



Hdp 



* / em ffw ym information about wKtrt you art, mhtre you hoot btrn^ and mtatfyu haix 
too&^ea^l eril otic^^ oofoo tho& ^^^^ haae oistto^l* I ca^^^t also ^^i^oo yeoL et^^oico* ^hl hat i%ootf 
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Atfrte 



Com H> Is « good am to apian. lt t ts tossiblt that tkt WumpusJs ft com /(?, htf rfc »Jl 
ntctssary risk. Thtrt crt no itftr umi. Wkot now? 



* 




\ ■ -.; ft- • 

I II, 9, i,*nd2. B^rrrf Wkot a itmV Wkyj^tf 



You *r« at am JO with nUfkbor, 
II 



It U tossM< that am II amtdns « Jtf. ICohM youlihotogo oimd with that wow? 

♦ * • ^ 

iPA«ffM«? 

t 

7 

Ko* c<w |» Urttbf to co* 7 from am fa. Would youHkia routt to com 77 

Y« '>\ "'- ^ 
^ • 

Goto9a*d tknto7. SW I mki tko mmsT 
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You art at c*m 7 with notghbors IS, 0, 9, and 11. What now? 
t 



You art at com 9 with neighbors S, 7, W, and I. What a stench] What now 



" ( 




You art at tarn I wUk ken 12, *, and 9. What a sttntfj What now? 



That U f fatal mm. Would jou Uk* adotct? 



Ym 



J. 



N 19 . 
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The Wumpus U thereby the following argument: 

Com 8 must be exactly tmo away from the Wumpus since tt smells and ea%e 19 dowh. ThQ 
means that either, cot* I, 15. or 9 must be next 4o him. . \ 

Cam*n is two away sine* Utsn*xtto4 which doesn't smell. Cute 9 isn't one away slnceyou 
watted tern 7 and that didn't smell. Therefore, h elimination, cave I is one away. Hence. ) 
one of us neighbors must be the Wumpus. U ' 

The neighbors of 1 are 8, 9 and 12. You hate tisUed 8 and 9 so. h elimlna/Um. the Wumpus 



Which moe would you like to shorn into? 

% s 

n 

CongmuJm^ms you hone shot the Wumpus! 
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t The structure of the advisor. 
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11 Mater capabilities 

The Wumpui Advisor has several capabilities organised around an expert Wumpus 
player that embodies a considerable amount of knowledge about the game. This expert can 
evaluate the student's move, compare it against the best move and explain differences so 
that the student will improve his game. Future versions will include a model of the student 
as a perturbation of the expert This will increase sensitivity to the particular problems 
facing each studeht of the game. In this section we outline fhe structure of the expert, its 
capabilities. Its basic method of deduction and its, advising and explaining strategies. 
Section S covers the details of each of these topics and section 4 outlines an improved 
approach developed by criticising our present effort , 
Our expert Wumpus player has four major capabilities. 



I It deduces information about the state of the game from what it knows the player 

■ ' ■ • 

knows. 

Z It can evaluate any move that the player can make 

. ■ 

J. It classifies aR moves according to a set of categories designed to capture the major 

strategies of Wumpus playing. - 
4. Its evaluation of a move is modular. 



erJc 



Atuny time M a Wumpus game the player can see a small portion of the warren and 
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can remember areas he has visited or has seen from a visited cave. He has partial 

knowledge of the warren from this Information. He can use his memory of the location of 

e bats he has come across and all the evidence from smells, breezes and squeaks that, he has 

discovered in the course of the game.' A good player should be able to deduce useful 

information about the position of various hazards $y combining this information and 

using inference rules entailed by the rules of the game The expert makes most of these 

j 

deductions, only tiling information, tW student knows or ought to have remembered. In 
time, the advtoor teaches the student to make all of these deductions himself in a reasonable 
manner and to use the information discovered to make a best play. There are two Broad 
classes of information* our expert can deduce. First, it can often determine exactly the 
positions of a bat, pit, or the Wumpus, or can tell that a cave U definitely free of such 



hazards. This is clearly important to good play for hazards must be avoided and safe 
caves are wortb^nvesttgatlng. Second, and very Important in uncertain and incomplete 
situations where definite facts are unavailable, the expert can evaluate probabilities of 



hazards for any particular cave Various heuristics are used for this and they represent 

- - r 

qualitative knowledge about using evidence to makfc decisions. 

Information gathered by these techniques b then used by the expert to evaluate each 
possible move All moves are treated Independently. There is ho need to plan ahead in 
detail state a move can almost always be made at anytime if afW Only when a bat 
transfers a player to a remote part of the warren do caves become ^Accessible. Even in this 
caie the warren to so interconnected that it is unlikely to be much of a handicap. A move 
evahtabon consists of a probability assignment for each hazard type and a simple measure 
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of the information that would be gained by the move. So cave. 3 may have a 0.3 
probability of a pit, a certain bat and definitely no Wumpus. It may be near the Wumpus 
and to be likely to give information about it 

, The expert has an executive which classifies all possible moves according to t seven 
point scale of goodness shown In figure I and discussed in detail in section 3.4. Each 
category is a distinct type. Safe moves are preferred to unsafe ones and given two moves 
of roughly equal safety, the one which reveals most information about the warren and the 
Wumpus is regarded a? the best All moves in the fringe area are considered. These ape 
caves which are accessible but have not yet been visited. It Is a waste of time to visit a cave 
that has already been visited unless It is on the way to Mother profitable cave In the 
fringe If the player does visit such save it Isiwumed he is going somewhere valf ble 
unleas^he wastes too much time by going In prof itless circles. 1 ' v . 

The expert is composed of four main units, an executive and three, specialists, one 
each for bats, pits and the Wumpus. Naturally, from the symmetry of the game, the-bats 
and pits expert are very similar and use similar deduction rules. Each specialist deduces 
what it can about Its associated heard and reports to the executive. Modularity allows for 
a comprehensible expert which is a natural advantage for teaching purposes. The student's 
play can be evaluated separately for each speciality and abo on their integration. We 
expect that th)s will make it easier to construct student models. It certainly allows the 
currant advisor to advise about one particular module at a time. 

V 
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EXECUTIVE CLASSIFICATION 
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, IS THE CAVE SAFE? 


DOES THE MOVE 
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uutfus 
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ON THE 
UUMPUS 


1 
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* 

3 
4 
5 
6 
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YES 
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YES 

' .'YES 
'YES 
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TYPE NO. 



1 

2 
3 



4 

5 
6 



MUMPUS VALUE 




BATS 4 PI TS VALUE 



8 < VAL < 1 
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Bat^-plt eafety ha» been .given precedence. The bati/pi te**ejue of a cave 
the prbbabilitu/ of death by bate or pits in that cave. The Uuapus value 
1 If the cave la eafe froa the Uuepus but.uill give Inforeation about It. 
If It^K eafe but ulll give no Infometion, aft) 3 if It je unsafe. 
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12 Extra facilities 

* 



Several extra facilities have been added to the bask expert outlined above. They can 

4 i- * 
v • * * 

be thought of as extra modules although they do not relate to the executive in the same 
clear way as thl three hazard modules. All three of the facilities we next describe could be 
improved greatly and integrated into the advisor more cleanly. 

Wejntlude a simple help specialist which will offer the student a'good move when « 
he is in trouble and. will also present an exphiSIteo of it if the student desires. It is almost 
entirely a call to the expert for the current best move. We make no attempt tj> supply a 
move which ifcaltored to the students current difficulties. This enhancement will only be 
reasonable when student jnodelling is implemented. _ 

, Since the player may not" remember all of the warren he has come across so fat we 
provide a route finder specialist. If he has any^lffkuky in reaching a goal suggested by 
the move suggester the advisor will offer a route through known safe caves. This is 
coupled with> help facility which gives the player information about any cave he has 
visited on request 

More important and* most In need of further development is the shooting specialist 

*» 

whose Job it is to prevent the player from wasting arrows and to advise him to ^shoot If he 

7 

, should be able to deduce the exact location of the Wumpus. It will dissuade the player 
from shooting if he has not located the Wumpus exactly or If he shoots into a cave that 
could hot be the Wumpus, especially if there are otmjf worthwhile things to be done. 
Future shooting specialists ought to weigh up the risks- of shooting, the value of the arrow, 

th* poutfrthty of httttaf the Wumpus and the availability of good/plays Wwher^T We 

3 or 

<~0 
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r€9»m to this when we consider a decision theory paradigm for future Wumpus advisors. 

* rX_ • * 

U The advi sing paradigm 

The advising paradigm for our current program is a simple one. This is because we 
do not vet have a component which effectively makes models of the student. Our system, 
describes hts immediate behaviour and not the reasoning thai led him to this. As a 
consequence, the advisor- will advise when the student makes any non-optimal move and 
will give him a description of his bad play whichfis usually too full Nevertheless, there are 

some subtleties involved even using our simple t&hniques. \ A 

~~ ' » * ^ 
' While discussing t|e expert we noted that the executive classifies the student's- move 

according to a seven point set of categories (see figure I). We associate, a program called a 

move-type-analyst with each type in this category set The Job of such in analyst is to 

comment whenever the student makes a move of that particular type . Each analyst will 

>t- v '" * 

check to see if the student made a move that wis significantly worse than the best possible 
before it criticises him. The conditions for this vary according to the particular type and 
this Is one reason for having separate analysts. In general the best moves are the ones with 
the lowest classification numbers and 1 a drop of one makes a significant difference. This is 
not always the case, for example move-classification ^(unsafe because of bats or pits but 
•are from the Wumpus why* giving information about it) Is not always significantly worse 
than class S (safe from bats and pits but in danger from the Wumpus) even though in 
general a drop of one class does make a significant difference. , 

- Tht comments made to the student depend on move tjrp*s as well as on the particular 
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board steieFirstl$ the analyst comments on the move type itself with some statement such 
as "thaUs a flaky move". Of course If there is no safe move it will say "good luck" arid 
leave the -player to his fate but- often more specific comment is needed. There are two types 
of bad feature a move may have, those that are avoidable and those that are not. The 

' C v 

analyst only comment* on the avoidable ones, a property which depends on the better moves 
available at- the time. If the avoidable danger was a^at hazard the bats expert would be 
called in to give an explanation of the hazard. The Implicit assumption^ that the student 
did not see it 'With a good student model we could distinguish oVtween this and the case^ 
when the player* noticed the hazard but failed to see any better move. The advisor focuses 
the player's attentjjqj^and stimulates him into finding a better move bf^refering to the 
hazard as a reason for not rfe|»ng the move he tried, It Is also possible, that the student 
found other moves which were free from the criticism but noticed faults in these that he 
was mistaken about or that he gave too much weight to A good modeller should alloWus 

a< 

to adapt advice giving jto cases Uke this, 

• Having criticised the player's move the analyst allows him to think for a while by 
asking him If he wishes to go aliea^^he player can change his move and will theyjbe 
offered, a better one On request from the player the analyst win compare its suggestion 
with the player's move The explanation is comparative so no common features of the two 
^novei need mentioning. . ^ 

^ • We have summarised* that part of- the advisor that currently fltl nicely into a 
\tmework. Throughout the program are numerous patches that Improve advice giving in \ 
way*. * Examples of such special cases ate, advising about / sKoot»ng, commenting on 
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rcpettcd mistakes and cautioning about time waiting by moving only into visited caves. 
.We hope eventually to include these in our theory. , 



14 Sensitivity, to the student 

Although no student modelling is done by the current version of the system there are 
two comments to be made about the way the program deab with the issue. First, some 
adaptation to student performance levels is made even without active modelling. The 
student is asked % rate himself on a fpur point sale of Wumpus hunting ability. It would 

be fairly easy to have the program actively make such coarse judgements over a perkrfof a 

' * \ , * 

few games. The rating Influences the advisor behaviour in three ways 

i 

v m m 

^ a) provision for initial id Vice,, ^ . . 

b) pruning ex pfanations,. 

t) pruning the expert's deductions. ~ 

* 

' It the player is a raw beginner there are certain features of the game he might not 
have realised. For example, baa are not as dangerous as pits since they usually land "you in 
a safe cave. Immediate observations such as these are told 'perhaps once or twice to a 
beginner and are not mentioned again. 

The program can generate detailed explanations by tracing, through the deductions 
made by the expert in determining such facts as probabilities of bats. It is useful to prune 
this advice leaving only relevant facts. The two most general approaches involve 
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techniques not yet included in our advisor. One involves natural language dialogue. If the 
student were able to ask the program. for detailed explanations when he needed them, the 
advisor could explain in a top-down fashion, beginning with the main steps of the 
deductions and awaiting prompting for particular substeps. . It is possible to allow some 
form of prompting without a natural language capability if for each lower level step the 
advisor asks the student whether he needs an explanation. -~ . 

•t^tecopd method requires a good student model to determine what the player already 
knows. We incorporate a coarse version of this procedure. The student is asked tyiescribe 
his level of play as a number from I to 4. The difference between a very good player and a 
novke is enough to Justify ommitting explanations of simple steps when advising the good 
player. Though this does not solve the problem of overwhelming t beginner irtth detail, it 
' does improve the situation for a good player. jL ' 

Finally, we assume that one who claims to be only a moderate player wjll not make 
any of the more sophisticated deductions or probability Judgements that our expert can 
make In this case we remove the relevant deduction rules from the expert to bring it more 
to the level of the player. This can .be expressed as, Regardless of the student he must 
. learn to wf Ik before he runs". Because of the modularity of the rules we can make this 
^ agistment easily^ The same property should aid us in designing a realistic student 
modeller m the future. When carried through this leads to the notion of a "syllabus" which 
la an organisation of the teaching material that provides guidance' for deciding in what 
order the materia! should be presented. 
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IS Dedwcttoo paradfrm " 

• * > « 

♦ * * 

Moit moves in a game of Wumpus yield information which may be used as evidence 
for locating and evaluating dangers^ the board. We describe the detailed deduction 
procedures/used for going this In section 3 but it is worthwhile to make some genial 
observittoos about the deduction paradigm we used. We use four main headings for our 
•description. 

" H ''No J *' ^ 

1) An asserttbnal data base, 

t 

2) Antecedent theorems,'. 

S) Special representation of disjunctions, 

i) Mathematical fu/Ktfons for evaluating probabilities. 

The assertions! data base contains information representing the state of the warren 

when It is set up. It includes the connections between caves and the exact locations of the 

player and the hazards. Initially, the player knows nothing about the hazards so we 

distinguish properties «nd relations which describe ills changing view of the world as the 

pme progresses from the actual state of the world. The expert, of course, plays from the 

flayers point of view although it is conceivable that future programs with more 
> - ■ * *' 

"cheat" and help the player avoid difficulties he is 

unprepared to face? ; There are two types of properties and relations. One set of properties 

is a primary set including such properties as >MELL. VISITED, etc It U assumed {hat any 

player will have these as part of his vocabulary since they are so closely tied to .the way* In 
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which the rain of the game are presented to him. Other properties, such as l-AWAY, 2- 
AWAY, are more remote. They appeared useful to us as we designed an expert. It is 
important to note that the student might not have these in his vocabulary until tile advisor 
shows him that they are useful Left to himself he could come up with a totally different 
representation for his play. We assume that there b only one good strategy and all the 
program's explanations are phrased in terms of the vocabulary needed for the inferences 
In vftlved in this. The hope is to set the student thinking along the same lines. It is 

r* 

important for future work .to remember that different people may represent problems 
•^differently so that a better advisor must be able to determine a student's representation and 
model him accordingly. In Wumpus type situations it may be important for the advisor' to 
tec how the student represents the warren diagramattcalty though, in general, multiple 
representations poses a very difficult question. To summarize, our program uses a single 
*■ predesigned representation and attempts to impose thb on the player. 

Wumpus is a sufficiently simple game that antecedent methods can be used to keep 
- track of new deductions. Whenever any new information appears the. expert draws ad 
implications it ever will between this and the old information. Thus w^ capture one aspect 
of a game player. He has- a view of the game state which slowly changes as new 
information interacts with it The expert has theorems which determine features of caves 
audi ^ s being on e cave away from the wumpus, being safe, or containing the Wumpus. 
Some of these are simple, for example the condition that an arrow misses the Wumpus. 
would trigger a theorem to assert that the cave the arrow was fired into is safe. Other 
theorems have several possible triggering conditions because a feature of a cave can 

v 
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depend upon features of an Its neighbors. It also happens that a theorem may be triggered 
to prove a property already known to be4rue. In order to prevent unnecessary chain 
reactions of triggering an antecedent theorem always checks first to see If its result is true 
already. 

Than design fwiturts art common, Knowltdgr to Al programmers but take on a new 
■ H t k tn «* P**t program. They art ftaturts which could improve a player's 
m tame If he organised his knowltdgt by them. 

y ■ ■ 

When the expert deals with bat and pit inferences it is interested in the probable 
locations of bats and pits. This requires it to represent disjunctions such as "there must be 
a bat In cave I, 2 or S". We were led to use a special representation In terms of candidate 
sett. In the example kist given there would be a candidate set of (car el cave? cave))! Bats 

* ' * * * 

and pits deduction procedures were designed around this notation and manipulated using 
intersection, sizoVid set Inclusion. \ 

..Evaluating the likelihood of a bat' for any particular cave differs from the logical 
deduction process used to find the exact features of ayes since It involves probability. It Is 
extremely hard and messy to' apply probabiMty^theory exacjlyto the Wumpus situation. All 
'probabilities are conditional on the partial Information already accrued at the particular 
stage of the game This leads to complex formulae at best and exhaustive combinatorial 
search at worst Our expert Is Instead a model of heuristic and approximate probabilistic 
reasoning of die kind that knowledgabfe game players use tn common 1 sense Judgements 

X ft 

about the game. We determined four general methods that might well be used to estimate 
probabilities and adjustment the results to account for multiple evidence arid the 
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phenomenon of evidence being explained away. Our rules embody simplifying 

• • 3 

. assumptions and are generally useful outside of Wumpus. Though we expect that most 
students will use some qualitative analogue of our^ules, the advisor represents ^ them as 
mathematical formulae embodied in procedures, this has a quantitative nature which 
makes verbal advice hard to give. The advisor overcomes this partialis by pointing out the 
evidence it uses as data for its formulae and then saying that the student should deduce it 

V > 1 

to likely (probable, etc) that f he cave in question contains a hazard. We, don't yet know how 

\ % 4 r - 

much advice giving about common sense reasoning canoe based on a quantitative model. 



It Ceneration of explanations 

* The Wumpus advisor gives detailed explanations of its reasoning. This leads the 
student to deduce useful properties of the board position and to use them when deciding on 
an appropriate move Explanations are produced in a very simple way similar to that used 
in Stansfield (1975). An explanation bears an almost isomorphic relationship to the*^v 
deduction procedure that is being explained. Each general rule of inference fcapociated * 
with an explanation function. If the rule is of the form "A and B implies C". the. 
explanation function prints out an explanation of the bask form "C because A and B" 
Since rules may be applied In many cases, many explanations can be produced by the same 
explanation function. This is only the simplest example of the method which is extended 
Iq two ways; First, A and B, the premises of the rule, may themselves be consequences of 
other facts and i m pl i ed by other rules. The explanation function for. "A and B implies C" 
cans the explanation functions for these rules and so on. Eventually a complete and 
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detailed explanation of the Inferencmg U produced. Second, each explanation function is a 
procedure and can easily have idiosyncratic behaviour. One common addition is for a rule 
to state itself as wen as the particular instance. So we could have "Qaves you have visited 
are safe You have visited cave 5 so tt is safe". It would be possible by keeping a simple 
record to have the rule. printed out with the Instance for the first few times only. Other 
additions make the English output flow better and, occasionally, context sensitive aspects 
can be added. The program will usually refer to a visited cave at "cave x which has been" 
N visited" but became of context might say "cave x where you are new* Up to a point, these 

• «nbeWshments are easily added and the advisor' has many. A general purpose English 

> / 

ojitpui program must be the next step (see Steum 1975, McDonald (forthcoming), Rlesbeck 

W75X < 

Since the expert program is modular and contains an executive, the explanation 
functions fal neatly into cksses^Some explain about bats and pits or about the Wumpus 
and some about the strategy as a whole ' 

11 * "* eXampl * thlt *** ex P hm * l *«« become longwinded and 

detailed. To some extent their hierarchical nature eases this but it would be preferable for 
only the more relevant or important parts of the explahattoh^be given to the student so 
that he is not confused by too much information. We could have Included various ad hoc - 

hr techniques for pruning explanations which would have been moderately satisfactory. It 

* 

•earn* more sensible from a research standpoint, to first Improve the student model so that 
there Is a good basis for Judgements of relevancy. ' 



^ M ' Wumpus Advisor I 



* | Proeraaa details 

's, 

jj jaUanj otu aaoawles 

The bats and pits modules of the expert embody about eight rules of inference and 
uae them to determine the positions of bats and pits. They are of two kinds, logical rules 
which can be used to deduce the exact location of hazards, and probabilistic rules which 
can only estimate the likelihood of bats and pits in any particular' cave. Both types of rule 
have already been discussed and here we describe them in detail. 
' There are four logical rules for bats. 

a) A squeak heard in any" cave Implies (hat there is a bat in at least one neighbor oT /he 
• cave I - - • 

b) Visldng a cave win ten you whether that cave contains a bat 

c) If a cave does not squeak then none of to neighbors can contain a bat. 

d) If the total number of bats Is given, they can sometimes be located exactly. 

* , 

Rules for pits are almost identical, the one difference being that rule b) is of little 
ism* If you fall in a pityfhtgame is over whereas a bat .may simpty carry you to a safe cave 
elsewhere. Rule d) is fairly complex and is not implemented in our system, it works 
tf "»ny «nore caves- next to known squeak caves and only a few bats in 

the warren than only certain arrangements of bats win explain all the. squeaks. The crucial 
point about raks a) b) an/ :) which a beginner may not. immediately notice Is^nat b) and c) 
/ ^ha? rale out postabiattes suggested by a) to have only one. In this case a bat or pit has 

35 



4 



Memo 381 



{ 



Wumpus Advijor I 



been exactly located. Knowing the exact location of »bat In such a manner can in turn 
a|low the probability rules to explain away certain squeaks neighboring that bat^ This 



could lead the expert to conclude that certain caves are safe 

^e 




figure 2. 



Consider the example In figure Z Caves with circles around their numbers have beeh 
visited; cava I. 8 and 4 are known to squeak; caves 2 and 7 are known not to squeak. 
Because* the squeak at cave I, either cave 2, i or 8 must contain a bat by rule a). But 2 
cannot by rale b) (It has been visited) and 6 cannot because of the lack of a squeak at cave 
7 by <rate cX This leaves only cave 9 as the bat cave But a bat at 3 explains away the 
squeak at 4 so there is no reason to suspect a bat at II or 5.' 

To Implement the rales we use candidate set*. Firstly, the state of the board as seen 
by the player Is represented in the data-base using the properties KNOWN-SQUEAK, 
KNOWN-NOf-SQUEAK. VISITED. V-BAT and KNOWN-NEIGH BORS. V-BAT 
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means the cave has been visited and contain* a bat which, therefore carried the player away 
before he saw the neighbors of the cave Next a candidate set is generated for each squeak 
cave, duplicate sets being flushed At least one bat must be in each candidate set. A unary 
candidate set U added to account for each visited bat cave The sets produced to account 
for figure 2 would be 



(2S6) (3 lllfTtlO) (K» 

Next, rules b) and c) are applied to remove caves from candidate sets. We now have 
the sets 



(s) . (3 n 5) (K» . 



Lofkalty; in our example, we have deduced that caves S and W contain bats. If we 
knew that there were only two bats in the warren, the un im pleme n ted rule d) could be used 
to prove that 11 and 5 are absolutely safe 

At this Mage, the logical rules are exhausted and the probability rules take over. 
There are four probability rules, each corresponding to a fairly general rule for estimating 
-1^, b«d * HiMtod cvMcnee. The n*. « ^ of ih. .ppte..« 

of simple probability theory and Bayes 1 rule. We will describe each one saying a few words 
abou t 111 implementation. The rain are as follows. 
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a) Equal hkeHhood 

b) EVidcnot can be explained away 

c) Multiple evidence can increaje probability 
' *) Multiple evidence can decrease some probabilities 

Whenever exactly one of a set of equally likely outcomes must occur, simple 

* 

¥ 

probability says that the total probability must be I and "an estimate can be made of the 
probability of each outcome. This rule applies approximately to any candidate set^ 
^/produced by the lof ical roles. If the set has N members then we may deduce that the 
probability of a bat being in any particular cave is l/N. We can compare the safety of 

alternative moves because caves In smaller candidate sete are more likely to contain bat*. 

i 

This rule la approximate for two reasons. Firstly, there may be two bats in any candidate 
eet although for a large warren and few haiards this is unlikely to make the rule 
% inaccurate. Secondly, knowledge about the remainder of the warren may influence the 
probability of a particular cave having a bat in subtle ways. 
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1 figure 3. 



A particularly common way that this second cue irises U that a probable or certain 
bat in one cave explains away evidence that supports a bats being in that cave as well as in 
several others. This rule can be applied whenever one candidate set is a subset of another. 
Figure S shows a cafe with two candidate sets (1 2 S) and (1 2). The bat in (I 2) due to the 
•qoaaking explains away theaqueak at 4 that gave rise to (I 2 $) and there is no reason to 
beHeve a bat exists in S. Evidence supporting S is explained away by the bat in (I 2). Our 
current advisor Implements this by reducing the probability for 3 to the likelihood thaFa 
bat was put In $ by the program which set up the board. 




figure 4.3,9' 
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If two candidate sets overlap we have a situation of multiple evidence. Figure 4. 
•hows a caw where a squeak at I gave rise to a candidate set (2 3 4), and a squeak' at 5 to a 
set (4 * n A bat at 4 would ef plamatyhis evidence. Alternatively, two pieces of evidence 
point to 4 but only one each to £ 3, land 7. We implement the rule for this situation by 
coiuld^thepfobabitorof no bat Ml ^ 



P(bat at 4) • I ^P(no bat at 4) 

-Vp<batln(2S))0P<batln(6 7J) 4 



i * N m 

A general version of the formula can easily be derived from this. 

« . 

ThU rule introduces a problem. If the probability of the common case is Increased 
then the total probability for each candidiasis raisedTbove 1.0 which violates our initial 
approximation- of «* d *"l« r cave. The greater probability of there being a bat in the 
eommon area should partially explain away the evidence and reduce the probabilities for 
the other cases. Since the exact formula for this would be cumbersome our program uses a 
rough formula to average out the discrepancy^ by reducing all the probabilities by a little. 
This 4s the fourth rule. / 




\ - 




figure 5. 
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Another problem irises when more than one rale applies at once. Figure 5 shows two 

1 Mid 2, both squeak and are both neighbors of cave S. If cave I is also nexf to a 

cave which is known to contain a bat then, its squeak is totally explained away and gives no 
■ \ . # v 

further information It cannot be used in conjunction with cave 2 as a case of double 

* 1 • % 

evidence for a bat in the cave connecting I and 2. This means that we must apply the' 

• t, ♦ 

explain-away rale before the double-evidence rule. Such priority constraints occur often in 
programming so we should lybVfcrfprised when a student needs to know them as part of 
. the htr own program .for playing a game well l ^ . 

The four rules give estimates that fit the intuitive judgements, generally* made by 
players. The advisor states the factors used in the evaluation and gives a rounded off 
version of the result of Its own formulae tt was unimportant for us that the student could 
prectejy apply probability theory and we preferred that he be led towards making well- 
four rules we tt*e tir^Ue for this and are applicable In otWi 




domains. 



1 



v. 

M The Winpti module \ 

More complex deductions can be made about the location of the W urn pus than about 
bats and pits. Because a smelt means that a Wumpus is within two caves rather than In a 
neighboring one Is weaker evidence than a squeak or bireeze and |ives rise to a much 
targer candidate set of possible Wumpus caves* On the other hand, absence of smell rules 

V * An 

42 



out more caves than would absence of the other types of; evidence. Since smell-generated 



♦ 
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. ttMidate icts haVe a radius 6f two caves it is possible that a neighbor of the smell cave U 

v * 

tin visited making the candidate set Incomplete. It U abo difficult to tell If moving from 
ope <mc9 cave to another take* you closer, further away or leaves you at the same distance 
from the Wumpus. Ajf these factors lead to a more complex set of inference rules than we 

* * - 

need for the bats modules. C 

Tnere are two simplifications which make the problem tractable. Future programs 
. might cover the more general case and K would abo be interesting to vary the type of 
Wumpw evidence (intensity of the smeR with distance from the Wumpus or number of 
Wumpi for example) to see what rules would then be needed. The two simplifications we 
have made are asTodows. • 

1) The expert only makes bgk»l deductions about the Wumpus and hot probabilistic 

V ' £■ 

^judgements. 

2) In the original game the Wumpta may move when aif* irrow is fired which misses 

* 

him The Wumpus is fixed in our version. * 

K * • 

T * * 

We examine ways to make probabilistic Judgements about the Wumpus later. If the 
second simplification is relaxed and the Wwtpus u allowed to move, older evidence would 
be degraded but would nor lose aN Its value. A smell cave which before a shot had implied 

3Mw Wumpus was withjn two caves, would now mean he must now be within three. A 
bell cart would now guarantee only that he Is -not in one of the cave's neighbors. The 
In variety of evidence wouldjnake tfe rates more complex. 
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We use five major Wumpus finding rulet Each is further away, from the rules of 
play than the bat* rules are and requires some simple proof of its correctness which 
naturally should play a part M the explanation of the rule given by the advisor. The rules 
are methods for deckling one of five properties of a cave namely , SAFE, TWO- A WAY, 
ONE-AWAY. WUMPUS, and MOR E-TH AN-ON E- A W AY. 

Rule I ct)AL - To prove a cave is SAFE 

9 

A cave is safe; 

a) if it h*s been safely visited 

***** 

b) jfiwn arrow has been fired Into the cave and no Wumpus was hit «. ». 

c) If there is a NO-SMELL cave; within two caves of it 

This rule is easily Justified and to invoked whenever one of the properties. VISITED, 
MISS, NO-SMELL to asserted about the cave in question. 

t % ■ ' ' 

Rule 2: GOAL - To prove a cave to MORE-TrtKN-ONE-AWAY 

A cave to more-than-one-away from the Wumpus; 

a) if we can prove it to be two-away 

b) If It doesn't smeN 

i 

e) if a neighboring cave does not smell 

a) la obvious and b) and c) are simple since if a cave were the Wumpus or one away 
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Men* 381 \ . . } ■ & ^ Wumpui Advisor 1 



• 7 * 

then aH of its neighbors would smell Tjiti rule Is not exhaustive tyere are probably 

other ways to prove more-than^neawavnett but in use u Hmtod to these special cases as a 
help to later rules. 

Rttlejk GOAL - To prove a cave Is TWO-AWAY 
A cave Is two eaves from the Wumpui; 

a) If it smeQs and k is mor&ttan-one*way 4 ^ 

b) if it smelb (so all the neighbor*** known) and none of the neighbors is the 

Both parts of this rule need comment *Role a) depends on the configuration shown 

m figure 6. ''P 

■ * •*.::> ■ .* ' V - 

*'•>? 

SHELL 1 ' • Ito-WELL 




Cavt 1 Mitt t» •xtctly two fro* tht Uuftpus. 
f ffflurt 6. 



I 

is wtthm 



v 



Slnce»ave I smefls^Jt is widiin two caves of the Wumpth and must be either one or 
two caves away. But cave 2 must be mere than two caves away and, as I and 2 are 
connected, the only consistent case is for cave 'I to be two away from the Wumpus. Both 
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caves most be visited for this rule to be applied and the rule is triggered when any SMELL 

* 

or NO-SMELL cave Is discovered. 

Case b) succeeds by proving that the cave is more-than-one-away from the Wumpus. 
Since It smells, it is either one or two away an) so must be two away. Notice that rule 2 
does not help here Instead, we prove that no neighbor U the Wumpus cave so the cave in 
question Is more-thafrone-away. This lute is triggered when any cave is shown to be safe 
by .rule L AH neighbors of the new safe cave are checked for smells and any cave which 
does smeft has the rule applied to it Alternatively, a new smeR cave may trigger the rote. 
If either caieof rule S succeeds it wiH trigger rule 2. • 

Rule* COAL - To prove a cave Is ONE-AWAY. 

v A cave Is one away from' the Wumpus is it has a neighbor which is two away and all 
other n eighbor s of that cave are more-than-one-away. 
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F%uft 7 shows an example m which care 6 must be one away from the Wumpus. 
The reasoning .is as follows. By rule 3a), cave 2 U two away Bat we know an iu neighbors 
and one of them must be one away. Caye I cannot be, by rate 2b), and since cave S b two 
away, by rule 3eX cave 3 cannot be one away either by role 2a). By process of elimination, 

4 

I 

-this means that cave 6 must be one away. 

Notfce that rotes 3b) and 4) are similar^ to the. bats and pits logical rales. First a 
candidate set is generated in which at toast one element has a desired property. Then all 
members ate deleted and the remaining possibility becomes a certainty. This technique 
could be caned "reasoning by elimination" In the bats case the property was directly related 
to the game rules whereas the Wumpus rales require some thought to discover relevant 
properties such as ONE- A WAY. It would be interesting to see if we could design an 
advisor that would lead a student to develop these Wumpus rates from the bats rates and 
to realise thai reasoning by default is a commonly useful method worth identifying and 
naming. We leave it to the reader to see how the method generalises to give rates for 

V 

Wumpi who smen more and ean be detected from greater distances. Rtfle 5 also 
uses reasoning by elimination. . / 

£ute & COAL * To prove a cave contains the Wumpus. 

A cave must contain the Wumpus if it has a neighbor which is one away from the 

* i * ' 

• > • 

Wumpus and all others neighbors of that cave are safe 

\ 

We can see an example of rate* in figure a, an extension of figure 7. Suppose the 
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player visited a« 6 and discovered It smelted and connected with S and JO. Since 6 Is one 
away and neither 2 nor it the Wumpus by rule 5, cave 10 must be Che Wumpus. 




figure 8. 

|| General rumminia — the Wnwu jjgdjte 

Despite the simplifications we made; the rales for Wumpus hunting are still complex. 
There are common elements and the rules Inter-relate by triggering each other at. several 
points. Nor art the rules complete. We could use the fact that there is only one Wumpus 




to help locate Mm. Figure 9 Is an extension of figure 7 where we visit cave 6 and disco* 
the now neighbo rs 7 and & The Wumpus must be one of these. But we have only one 
arrow left and daren't waste it So we visit cave 5 and discover neighbors 8 and 9. We 
have two candidate sets for the one vVompus, (7 6) and (8 9). He must be at 8. 
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Soch a large body of knowledge makes advice givjpg « difficult problem^ Our 
advisor applies the rates, detects any instance in which the student could have made a 
better move and prints out* protocol of the rale's application. This naive tutorial 
technique could be improved in several i rays. First, care needs to be take* over the 



^ur advisor foflows the paradigm of teaching 



distinction between a rule and ^instances, 
by example. It should also teach by 'giving general explanations. Second, the rules Inter- 
relate and it is non-trivial to organise them al to simplify their application. It is possible 
thaTa player knows al the rales but is muddled about them in practice. Thirdly, we build 
no model of the student's knowledge so it Is impossible to debug him when he uses an 
Incorrect version of a rule. He may prove that a cave Is two away by using rale Sa) but 
then think that al smrl caves next to It must be closer to the Wumpus and must be one 
away. We need a way to classify, detect and correct thesejrrors. 

Jnat as oar expert could make qualitative Judgements About the probabilities of belts 
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and pits, it is possible to introduce rules for Judging the likely location of the Wumpus. 
Th£e are two ways to do this. We can make use of the similarity between Wumpus 
hunting and bat finding where reasoning by ehmmation is used to set up candidate sets. 
All the probabilistic bat rules wHI then apply to the candidate sets. Rules 5a). 4 and 5 give 
rise to candidate sets for the properties TWO-AWAY, ONE- AW AY and WUMPUS < 
respectively There is a transitivity p h enomeno n too. Probability results from rules 3 and 4 
can be used as evidence in rates 4 and 5 respectively. Here is possibly a general principle 
of plausible reasoning. An exact role has a probabilistic counterpart for use when 
incomplete or uncertain evidence to fed tntojt This would provide a nice basis for an 
advtjpr whose goal was to teach ptoudMe reasoning by weighing evidence. 

T)sn 

X 1 (2* 




1 



c 
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figure 18. , 

x \ • • 

A second total? different strategy for making probability Judgements is possible and 
gives rise to further principles of ptesnmte masoning of very general application. Given a 
board MM such as that in figure 10, wt can enumerate several hypotheses for the location 
of tfct Wutwptt Consider for example caves 1, 5 and &* Each of these hypothe ses will 

-19 • 
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explain away tome of the evidence In the figure. None of the hypotheses Is totally 
discounted but each requires a different set of extra properties to be trut,of the board 
whkh are stin to be tested. A Wumpus at 6 would explain all the smells and also the 
smeiVno-smen pair at 3/K). It needs no extra things to be true of the board. Hypothesising 
cave 5 however, does not explain the smells at 2, 3 and 7. It thus needs extra board 
connections and these may or may not exist Some measures of the evidence explained and 

. « > 

the extra constraints imposed on future discoveries can be used to compare the likelihoods 
of various hypotheses. Both measures are needed. Constraint measures can be used to 
compare hypotheses and the explanation measure "provides some absolute measure of 
confidence 

/ 

M The executive's move classification r 

The bats, pits and Wumpus experts are used to determine the probabilities of 
meeting a heard in any particular cave^ This information must be used by the executive 
to evahate a move The executive forms the strategy component of a Wumpus player but 
since the game requires little lookahead, planning strategies are hardly needed. Each move 
can be evamated on the basts of the current state and the avauabte alternative moves. Two 
strategies exist and a players behaviour can follow either or both for several moves even 
though he makes ai his decisions more by move. The strategies are called 'playing safe" 
and "gaining information" Wasting time can be thought of as a third but U a degenerate 
case of the first and the advisor dealt with X impatiently. ^, 

Playing safe means making the safest 1 move you can find. Clearly the safety of a 

: ' t 
v 50 ' ' % 
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/ cave depends on the probability of it containing a hazard and this U reported on by the 
respective experts. Pits and the Wumpus mean certain death so they are easy 19 deal with. 
They are independent and their Joint probabilities for any cave can be computed. A bat 
may be relatively safe since it does not necessarily leave the player, m a deadly cave.. The 
executive estimates the danger by using a simple formula which we .win -derive. If the 
number of caves is N, the number of bats b, and the number of pits p, then if we assume 
that no cave contains more than one hazard (a good approximation if N is much-larger 
than p and b) we can reason as follows. — 

■ 

Pfdeath by bat) 

-P(you land on a pit) — ' 

♦P<you land on the Wumpus) ^ ^ 

♦P<you land on a bat)tP(death by bat) / 

. P<death by bat) • deadly caves/oon bat caves - <p*MN-b) 

f 

This works because after being dropped by a bat in a bat cave again the chances of 
death are the same as they were on first moving into a bat cave Another way df thinking 
of this would be to sum an Infinite series wttjHPterm for each total number of bats it is 
possible 10 land on in one move A third^wly is to reatbe that the process of being moved, 
about by bats must eventually slop In a non-bat cave and there is no reason to prefer one 
any other so the chances are euttMy titer/ 
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We explained the derivation' of this formula in such detail became it is an 
opportunity to consider the amount of knowledge about the application ofc probability that 
a perfect advise* might need to explain. The moral is cautionary. In practice our 
executive simply evakiates the formula, and states the likelihood of death as a part of its 
explanation of the dinger in a cave. The student is expected to come to some similar 
decision qualitatively and to improve his reasoning to be coincident with jbe advisor's. 

Shooting arrows is also a tricky type of move to evaluate. Our executive only deals 
with this m special cues when the Wumpus is either located or known to be in a different 
direction f rem the shot A true estimate of the risk involved should include the probability 
of hitting the Wumpus since arrows can only be dangerous when they mtssr" 

The second strategy for play is to gain information. Again,, a move which has been 
made before gains nothing and the strategy degenerates into rtme-w»stmg. Information can 
be fathered an two main ways. Moving to a new cave gives information about the warren 
and perhaps also about bats and pits. However, new information about bats and pits can 
hardly be predicted. If a cave is suspected of betng^a bat or a pit. discovering that it is not 
could allow inferences to be drawn about the actual location of the hazard. In Wumpus. 
ex supinations m such detail are not very significant but it is easy to imagine real-world 
aituattona where a risk is worth taking for the negative information that may be obtained. 
A naive Wumpus player may rush Into dangers for this reason and the advisor will caution 

* 

him. Since Wompi can be smelted from two caves away and as certain cavessain be 
deduced to be two away it is possible and often safe to move into a cave that has a good 
chance of giving Information about the Wumpus. Again, the true value of the information 
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can only be gauged by considering the inferences it would allow. For our purposes We 

, 1 t 

simply distinguish between "possible* information gam and "probable* gain. 

the two strategies interact so that a decision theory model is needed to compare 



accurately the information gained with the risk involved. Since the version of Wumpus we 
use places no time constraints on the player, our advisor makes safe play more important 
thaiHhfotmatlve play. Before describing the mechanism for this, consider the following 
example of a case of complex evaluate*. In the beginning of the game it may be useful to 
take a bat uyeach new parts of the warren, especially if ail other moves in the locality are 
dangerous. There are relatively few pits so it is unlikely that death will ensue. Later in the 
game the safety of a bat is unchanged, At this stage, most of the warren might have been 

0 

investigated in which case the Information value of taking a bat is lowered considerably. It 
may no longer be worth the risk. It is possible for the player to be completely trapped so he 
can only make deadly moves or repeat his oU ones. In this case the vakie-oTtakm^a bat is 
that It might drop you in a new situation even if this had been^vlsited earlier. A decision 
theory and planning theory of Wumpus could in future bffhe basis of an advisor for th 
tevef of pity. 
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EXECUTIVE CLASSIFICATION 



SAFETY 



TYPE NO . 



1 

2 

1 

4 

8 

6 

7 



BAT « PIT 



YES 

YES 

YES 

NO 

NO 

NO 

DEATH 
* 



INF0RWT1ON 



.uynpus 


UARREN 


uumpus 


YES 


YES 


YES 


YES 


YES 


NO 


NO * 


YES 


YES , 


YES 


YES 


YES^ 


YES 


YES 


NO.. - 


NO 


YES 


YES 


DEATH 


NONE 


NONE 

• 









TYPE NO. 


UUMPUS VALUE 


BATS 4 PITS VALUE 


1 


1 






* 2 


8 


3 


3 




4 


1 




• S 


2 


0 < VAL < 1 


6 


3 




7 




l 



Bit-pit Mfttu h«« bMP givan prtc«d«nc«. 
figurs ll. 
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Figure II shows the move classif icttion scheme used by tie current executive to 

capttfe the two strategies, firing arrowsand using bats to gain information have been 

exckided from the evahtation. Safety is factored into safety from bats and bits, and 
H ' e •' ; 

from <he Wumpus. There .are seven classes of move excluding repeat moyes and 

"llfir* 1 r ° Mthl7 .° rder * S^ 1 *** Th< * ven an be divided Into groups of three. 
ftiMnd one. The first three are totally safe from bats and pits as proved bythe experts. 
'« Types 4, 5 and 6 are unsafe according to bats and pits and type 7 is certain death, the two 
„ STOup* of three are Umibrty organised tccordtag to Wumpus conditions. Best of ati a* 

. ' er ♦ 

ntovea known'to be'safe (kit next to smells and therefore likely to reveal information about 

^the Wumpus. Second are those caves which are safe from the Wumpus but unlikely to 

•» < •* 
■ five information about it Finally, we have the caves which aire unsafe from the Wumpus- 

* and therefore Ukety to give informatton about it Each move type 4, 5 arid 6 can be f urthW 

ranked according to the actual degree of bat and pit unsafeness. 



f» if . Tht "ttsificaUon U effective and to some- extent distinguished the strategies and 
places them in order of safety. It also clarifies the advice-giving role of the executive for 

at, we shall describe, each; move type has a corresponding analyst which specialises in 
... . *. •• * 

advising about moves of that type. 

. * . . There are fltffcultles in capturing the interplay between strategies in a classification 

scheme. Consider mpve types Sand 4. Both provide trtesame^plnd of Information so their 

rw»Wnf can only be determined for parriculaynoves^by the relative dangers Evolved. 

Again, classes 4 and 6 give the same Information and jjoer certain conditions each could 
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, be better than the other. A better viewpoint is to consider decision-making under 
. dangerous conditions to be a decision theory problem. The expert should be able to 
compare risks and prof its and* Its explanations should be in these terms. 

%B lie flow of control _ ^~ 

■ j ■ 

Figure 12 shows a simplified flowchart for the system. Whenever the program' 
requests a move, control is at point A at the head of the flowchart Certain special case 
•«Kh as shooting and requests for help are dealt with by special programs. Otherwise, the 
expert is caljgd^fo ctassify alt possible moves,' In particular the one the player actually 
wanted to make, and control is switched to an appropriate analyst for the player's move 
type Analysts consider the available moves to deddeif the player made a good move. If 
. he did It slows him to go ahead but otherwise* explains why the move was bad, partly 
using Its own explanation functions and partly using those associated with the individual 
specialists for bats, pit* and the Wumpus. 

4 The player is always allowed the option of proceeding but if „he wishes to change his 
move he Is offered advice .When accepted, this takes the form of- a good move and an 
explanation of the benefits of this move over the player's ' 



SC. 
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FIom of control . 
f Igurt 12. 
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UN J 




EXPLAIN 
BAD HOVE 


u 

« 


HP 


JFFER BETTEfj 



no\ tht only difference 

proclM veJUje"of the 



EXPLAIN 
BAD fPVE 



ay 

m| bp 



bft/pit danger to the 
•dvitor doesn't Motion 
th« Uuaput. 4 



BET 

hove 



3 



Hove- type spec i all ate 
(exaaple it type 5) 
h aeene "explalh about the Uuepue" 
bp aeent "explain about bate and pite" 

flgura!3. * 
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Figure IS shows the scheme for more-type analysts. It is self-explanatory except for a 
few points. If two moves tre of the same type they may or may not be of sufficiently 
.different quality to invoke advice-giving. Since mowe- t ypes 4, 5 and 6 have a range of 
safety from 0 to I. one move can be very safe while another of the same class is very risky. 
Second, th^expbnatton functions are context sensitive A move which is dangerous both 
because 'of the* Wumpus and pits would not always give rise to an explanation of the 
Wurnpus danger. If no available move was safe from the Wumpus the advisor gives the 
player the benefit of the doubt and assumes he has seen this. It assumes he chose the 
wrong move because he omitted to take proper account of the difference in pit safety. 
Theee aasumpbonrare a recent addition to the advisor and we only discovered tgl need for 

1 - 4 

V . *" 

,them by using the program. It is remarkable how interaction with a program reveals 
glaring design ommisions which would otherwise be unnoticed. 

Together the specialist modules for bats, pits and the Wumpus,' the executive and the 
adv i ce-g i v i ng components of each make up 4 the majority of the advisor. 
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„ 4 A iedajej taeerv approach. 

the executive module of the wumpus expert represents various types of danger and 
the ways information can be gathered by means of a table. In effect, all the decisions about 
trade-offs between risks and gains are compiled. This method .is restrictive and some 
subtleties of the trade-offs are omitted. We now describe a more uniform and general way 
of dealing with such decisions that wit be suitable for an Improved version of the advisor. 
It Is based on decision theory which is especially designed to represent problems of choice 
In uncertain situations like Wumpui The analysis of a problem using decision theory has 
three components. 

. * . * 

u , 

I A decision tree 

This is a tree of states of the world rather like a tookabead tree for game theory or 
panning. It is rooted at the initial state and at each state the player is given a set of 
alternate actions f/om fhfch he may chose one. In Wompo* a state representt the position 
at a point m play and the choices facing the player are his legal moves. For any move the 
player makes, the world, can respond In a variety of Ways and each has an associated 
probability of occurmg. If the player moves into a risky cave then two possible outcomes 
are that the cave actually contains the danger or. that it does not. A more detailed 
description of the, outcomes might specify the possible new neighbors that might be 

0 

discovered. A decision tree thus has two types of arc, those corresponding to the players 

» 

chosen and those that correspond to the world's The; only difference from a game tree is 

so 
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the special my that the pbfer's opponent Behaves. In game theory he ftes to make the 
, ,noTe whereat In decision theory he behaves according to probabilities that can be 
estimated. 

^. Ah wfihuH flB function for terminal nodes of the decision tree 

The terminal nodes of the decision tree have values for the decision -maker which 
can be cvahtated Jtf some procedure for doing so is specified. ThU procedure must take 
Into account al of the good points of being atjhat state and weigh them against all of the 
bad points. It calculates trade-offs. The most common method is to measure each cost or 
gain with a single number and to combine these by simple linear weighting. The value of 
cadi feature is multiplied by a weighting factor and totalled with the others. If a feature is 
good or very bad then ft has a larger weighting factor either positively or negatively. 
A back-uo function. 

* * 

Given a tree of Possibilities and values for each of the terminal nodes it remains only 
to decide on the best action to take at the initial state. It is possible to work out w 
expected utility each action has by working backwards from the terminal values. Suppose 
we have a state which allows several actions each of which has several outcomes all of 
. whlch\pre terminal We know the probability of each outcome for a given action and we 
know their vahies since they are terminal The expected utility for that action is easy to 
evathttte using simple probability theory. Which action should we choose? Clearly the one 
with the highest expected utittty. This means that the expected utility for the state is the 
highest of the expected utilities of the actions avaihbte at that state Now the state can be 
rnMidasd a terminal Kate since it has been valued^** we can continue backing up the 
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1 Al 



61 



Wwnpus Advisor I 



true until we determine which action to take from our starting state 

This approach to the analysis of a decision problem assumes that the value of a state 
can be determined from the vetoes of its component features. Four of these components 
clearly occur in Wumpus. «, 

I Risk of death 

The utility of dying should be very large and negative It cannot be minus infinity 
since this would multiply by any probability of death to be minus infinity. Instead, utilities 
could be a function of the probability of death. There are various- ways that death can 
occur, falling into a pit. wandering into the Wumpus, shooting yourself with an arrow, or 
being carried away by a bat Into a dangerous place These possibilities reveal themselves in 
the decision tree. If a student falb to account for any of them It is reflected |n his 
incomplete decision tree. The probabilities of several of these cases are quite tricky to deal 
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2. Information gam 

t The amount and value of information gained by any move are important. The 
vatoe depends on what is already known as new facts may allow important inferences. 
Information may be gained about the warren Itself and about the dangers in It. In 

* 4 

▼axtettons of the game, where the Wumpus may move It is possible to lose information. 
Inferences must be dealt with by a set of logical and probabilistic rotes such as we have in 
the existing advisor. • 
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The ultimate goal of the game to obvkxuiy an important consideration in deciding 
upon the value of a state. It is not sufficient to make safe moves or to find out 
information. It to abo important to kll the Wompdt Ki King the Wumpufroust thus have 
a high positive value. A small chance of killing It may be better than a large chance of 

* 

gaining Information. In variations of the game It would be possible to injure the Wumpus 
perhaps slowing him down if he can move around the warren. 
4 R« 



A very important value m real-world situations to the value of resources. This was 
after all One of the main reams for inventing money; The only resource used in our 
current version of the game II a supply of arrows. It to dearly very silly to take a chance 
with your hut arrow though It may be worthwhile testing hypothetical Wumpus locations 
with the first few. Many other resource types could be added to the game,, time constraints 
.being one of the more general Given a fixed bme to phy before the warren falls in on 
you wll affect your play. It would become bad play to waste time. A more interesting way 
to introduce time to to make the Wumpus actively took for the player, eating him when it 
find* him. ^"hto could become a two player game with the advisor watching or else the 
advtoor could be one of the players. 



From the dtocoastons of each of these com ponen ts it is easij^en that Wumpus can 
have many I nte resting variations and at of the variations easily fit into the framework 
of dexttoon theory. A newer advtoor based on such an approach would be able to advise a 

' * . S3 
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user about playing a> the differed variations. So far our goal for the advisor has been to 
introduce people to a situation in which the implication! of a few logical rules are 
Important for sensible decision making. In particular we chose a situation which had 
uncertain information. This natural? leads to the extension of teaching decision theory. 
When we consider this we discover at least six types of bog a student may have which 
directly concern decision theory some of which were out of the scope of our current advisor. 

I Failure to tetre probabilities. 

Faihsre to determine the fckefchoodi of the various outcomes. of an action win cause 
errors when trying to back op the decision tree. 
2. Inappropriate uubtr functions. 

The student may have utility functions which are inappropriate for winning the 

game. He may think that pits are leu dangerous than the Wumpus for example. Or he 
* 

may be playing the game according to a strategy which requires a different set of utility * 
functions. He may wish to fall into pits to help him remember the result of such an action 
or" to check his hypothesis about what wil happen. He might also be more interested in 
playing for fun than playing efficiently An advisor that could recognise and relate to this 
would need to take account of the player's values accordingly. 
IFaihireto a m yj the alternatives. 

m Expressed m the decision theory paradigm this bug corresponds to an incomplete 
procedure for generating a decision tree. » 
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± Refusal to cot teases. — 

This does not occur in Wompus because there are no long term plans involved. It is 
however a common bog which manifests itself in a distorted set of values. Past losses are 
weighted too heavily and actions are taken which have only. a small probability of 

• X • 

annuMtfig them. 
5. Myopia. 

A decision tree which to Iff deep enough win give rise to short-sightedness. Smatt 

Immediate gains wiB be preferred toWgHerm ones. Large long-term tosses wilt not even 

be considered. ^ 

8» Preoccupation with details. 

« * 
This to related to the myopia bog but instead of the* tree being too shallow it is one- 

sidat AM the planning, resources are used to plan ahead on only a few paths. The result is 

that when a move it eventually made it is either on the wrong track or based upon too 

\balow an invest%ation. 

■ \ 
Wumpus has v<ry simple strategies for play and though this was one reason for its 
choice It it perhaps time to consider what additional properties we would like a game to 
have for oor advisor to teach in an wtercstmg way. The simplicity of Wumpus largely 
ariats became at decision making for a move can be done at the time of the move with 
only the Information available at that time Each move is made separately. Unlike chess, 
the player does not need to make up strategies which govern the style of his play for a 
aaqpenc* of moves. Nor art there ofays and trick methods which help lead an opponent 
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Into an error. In short the Wumpus expert needs to do no planning ahead more than one 
more The bask cycle of play is to make inferences from current knowledge about the 
currtnt state of the board, pinpoint the dangers, choose a move to avoid these dangers, 
make the move, thereby gain information and finally go to the beginning of the cycle. * 

A more advanced game would combine incomplete Information with need for 
planning. Look-ahead would be necessary along sequences of actions each of which might 
have an uncertain outcome. >her* should be different methods of play that are applicable 
dtfferent dtuatkms. Since evidence gathering is as important as evidence weighing, the 
game situation should allow the player to design a set of methods or strategies for gaining 
information. Action in an uncertain situation is a feedback loop. Evidence is gathered and 
weighed and plans are made both for acting and for gaining new information. The plans 
may be based on hypotheses, and information gathering should be designed to test these 
hypotheses as wed as possible One possible candidate for a game Is the game "Clue" A 
murder has been committed and each player trier to play the part of a detective and _ 
discover three pieces of infofmadon, the weapon, the place, and the culprit Each pbyer 
has certain Information and by combining everyone* it would be clear what the answer was. 
A player may only get a limited amount of information from another at any one time. He 
thus has to make up strategies (•'determine the information he requests. Other players 
near every player's request bur dJnpt know the Implications of the answer fully. Players 
have to mow around a board to^JrhtfiUr locations before they can ask particular 
questions so an extra cost to Involved and other players may be able to infer things from 
this behaviour. 

6C ' - ' 
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Whatever game is chosen it will be necessary to combine planning with decision 

4 

theory. Fddman (1975) has shown how this can be done. The principle is easy to describe. 
A decision tree is effectively a planning tree showing aH the possible plans. The results of 
actions in these plans are uncertain but provision is made for each possible outcome. 



Instead of looking for the utility o£ a terminal state and moving so as to increase your 
expectation of this* value, all the steps of the plan have to be taken into account Each step 
has costs and gams associated with it and they must be added up to determine the value of 
the plan as a whole. Then the plans can be compared and tne best one taken. An 
important feature of planning in an uncertain situation is that plans must be revised after 
each step is executed since nyj information may change the situation. 

Sum^nlngjup, It teems th\t decision theory provides a rtch framework for 
improvements in the Wumpus advisor. In particular, the problems associated wtth making 
complex decisions involving conflicts of goal, limited resources, and uncertain information 
arte In a form which can be taught usefully by an advising program. These problems 
confront people often in everyday Mfe when they interact with others and when they try to 



make plans for the future. Although an advising program* written^ this early stage will 
not teach them how to cope with more than a toy situation, It Is a step toward* a ueeper 
understanding of teaching in this area. 
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